New bounds on the mass of a b' quark 
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In this work we present limits on a sequential down- type quark, 6', 
based on the most recent DELPHI data. Using all available experimental 
data for my > 96 GeV we conclude that a sequential four generations 
model is far from being experimentally excluded. 

PACS numbers: 12.15.Ff, 12.15.Lk, 12.60.-i 

1. Introduction 

The Standard Model (SM) of the electroweak interactions start to show 
some difficulties in explaining recent experimental data especially in the 
fermionic sector. What about a fourth family of fermions? Is is experi- 
mentally ruled out? Cancellation of gauge anomalies require the addition 
of a family of leptons for each family of quarks added to the SM. Since the 
number of light neutrinos (m u < Mz/2) is definitely equal to three the 
new lepton family has to accommodate a neutrino with a mass larger than 
around 45 GeV. Hence, if a sequential fourth family exists it certainly has 
to show a much different structure in the leptonic sector. 

Despite the strength of the previous argument one should try to experi- 
mentally exclude the existence of a fourth generation. In fact such evidence 
does not yet exist. The most recent precision electroweak results [2| allow a 
sequential fourth generation if the quark masses are not too far apart. The 
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same results also disfavour a degenerate fourth family if both the leptonic 
and hadronic sector are degenerate. This is in agreement with the conclu- 
sions of Erler and Langacker pQ. However, it was shown in 3 that even 
if one takes a degenerate fourth family of quarks with 150 GeV masses, it 
is enough to choose a non-degenerate family of leptons with masses of 100 
GeV and 200 GeV and a Higgs mass of 180 GeV for the discrepancy with 
experimental data to fall from roughly three to two standard deviations. 
Moreover, it is clear that any new physics will also influence these results. 

It was shown in refs. 011] that the mass range \mt> — my\ < 60 GeV, 
where t' and b' are the fourth generation quarks, is consistent with the 
precision electroweak data on the p parameter. This range enable us to 
say that even if my > mf, the decay b' — > t'W is forbidden. The decay 
b' — ► t' W* although allowed, is phase space suppressed and consequently 
extremely small in the mass range under study (from now on we consider 
my < m t i). Experimental data allow us to go only up to my close to 190 
GeV. Hence, the b' can not decay to a top quark. Furthermore, while some 
recent studies (see have constrained the Cabibbo-Kobayashi-Maskawa 
(CKM) elements of the fourth generation, they do not influence our results. 
Nevertheless we will take into account the 2a bound |14b| 2 +0.75|T4'{,| 2 < 1.14 
[H] coming from Z —* bb to constrain the CKM element V c y. 

There are presently three bounds on the b' mass for my > 96 GeV and 
all of them suffer from the drawback of assuming a 100 % branching ratio 
for a specific decay channel. The first one [Jj, my > 199 GeV, assumes 
that Br(b' — > bZ) = 100%. We will drop this condition and use instead 
their plot of a{pp — ► b'b' + X) x Br 2 (b' —> b Z) as a function of the b' mass. 
The second one [H] my > 128 GeV, is based on the data collected in the 
top quark search. Because the DO collaboration looked for t — * bW, the 
analysis can be used to set a limit on a(pp — > b'b' + X) x Br 2 (b' — > cW). By 
doing so we assume that the b and c quark masses are negligible and that 
a(pp — ► b'b') as a(pp — > tt). The obtained limit my > 128 GeV assumes 
Br(b' -> cW) = 100%. The third bound is from CDF [S] and is based on 
the decay b' — > bZ followed by the search for Z — > e + e~ with displaced 
vertices. They also assume Br(b' — > bZ) = 100% and their excluded region 
depends heavily on the b' lifetime. This means we can not use this limit in 
our analysis (for a discussion see 

Hence, we think it is worthwhile to reexamine the limits on the b' mass. 
We will use the CDF and the DO data which, together with the new DELPHI 
data |10j . is all there is available for my > 96 GeV. We will draw exclusion 
plots in the planes (Rckm, my) an d (m t i, my), where Rckm = I v c v \, 
from 96 GeV to 190 GeV without assuming a definite value for the branch- 
ing ratios of specific channels. Notice that the use of the Rckm variable 
provides a new way to look at the experimental results. This variable en- 
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able us to actually use and combine all the available data. Moreover, the 
new form in which the results are presented will serve as a guide to future 
experiments since it is possible to know how far one has to go to exclude 
the regions that are still allowed. 

2. b' production and decay 

At LEP, a pair of b' b' quarks is produced via e + e~ — ► b' V . The corre- 
sponding cross section was calculated using Pythia with initial state 
radiation (ISR), final state radiation and QCD corrections turned on. The 
results were cross checked in and agree very well with the Pythia results. 

The equivalent process at the Tevatron is pp — > b' b'+X with the relevant 
processes being gg (q q) — ► b' b' . Due to its hadronic nature, this cross section 
is equal to the top quark production one and it is known to order |12j . 
This approximation is used both by the CDF and the DO collaborations in 
their studies on b' production and decay. 

Two body b' decays occur either through neutral currents (NC) or through 
charged currents (CC). Although NC proceed only via loops, it was shown 
in ^3] that depending on the values of the CKM matrix elements and on 
the values of the quark masses, they can be comparable to CC decays. The 
reason is simple: if b' — * W t and b' — > Wt' are not allowed, the dominant 
CC decay is b' — > W c which is doubly Cabbibbo suppressed. 

As long as the Higgs channel is closed the dominant neutral decay is 
b' — > bZ. Other neutral decays like b' —* bg and b' — > 67 give smaller 
contributions but can sometimes be relevant. As soon as the Higgs channel 
opens the decay b' —* bH can be as large as b' — * bZ. 

The three body decays b' — > 6e + e~, b' -^>bvv and V — > bqq, including 
box diagrams were calculated in [Tl|. Using the results in ^1] we estimate 
[3] that all three body decays plus the decay b' — ► 67 are smaller than 
b' — > bg. Nevertheless, because we want to make a conservative estimate 
we will take it to be as large as b' — > bg. 

Taking V u y V u b ~ and V c b ~ 10~ 2 and using the unitarity of the CKM 
matrix we obtain Vt'b'Vt'b ~ —VtbVtV ■ Thus, we can write all branching 
fractions as a function of three quantities alone: Rckm, "V and my. 

One-loop calculations of the NC b' decays were performed using the 
FeynArts, FeynCalc 15 and the LoopTools/FF JH] packages. We have 
carried out several checks in the four generations model following |Hll3|IT3] 
and we have found full agreement. 

To decide on the relevant values of Rckm and m t i to use, we present in 
fig. ^the branching ratios as a function of the b' mass with Rckm = 0.001 
and m t i — my = 50 GeV. The closer to my = 96 GeV we are the larger 
b' — > bg gets due to phase space suppression of the competing NC V — > b Z. 
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Fig. 1. Branching ratios as a function of the b' mass. The Higgs channel is closed. 
The dashed line is 6' — ^ b Z; the full line is 6' — > b g and the dotted line is b' — > c W. 



In fact, for an almost degenerate fourth family and small values of Rckm, 
b' — > bg can be the dominant NC for my = 96 GeV. As soon as one 
moves away from this value, b' — > becomes the dominant NC. If the 
Higgs channel is closed , for my > 97 GeV, the competition is always 
between b' — > cW and 6' — > £>Z. As my rises so does the NC except if 
the Glashow-Iliopoulos-Maiani (GIM) mechanism gets in the way. It can 
be clearly seen in the figure the GIM mechanism acting for my « 125 GeV, 
that is, m t i — m t = 0. Then the NC rises again and the CC falls crossing 
at 140 GeV. When Rqkm grows so does b' — > cW and the crossing point 
is shifted to the left. As the mass difference tends to zero the GIM effect is 
shifted to my m t . 



3. Results and discussion 

Using the latest experimental data from the DELPHI collaboration and 
the data from the CDF and DO collaborations together with the theoretical 
values of the cross sections and the branching ratios we have drawn the 
exclusion plots shown in the figures below. 

The results based on the DELPHI data, are shown in figs. 2 and 3. The 
excluded regions in the two plots due to the limits on 5ry_» c w are the stripe 
centred in % in fig. 2 and the upper excluded region in fig. 3. The remaining 
excluded regions are due to limits on Bry^^z- When (% — m<) — ► 0, 
Bry->i,z decreases as a consequence of a GIM suppression and Bry^ c yy 
becomes dominant. In fact, when m t i — m t = 0, Bry^ c w ~ 100%. Thus, 
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Excluded by DELPHI R C km= 0.0002 

b" -> b Z 
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Fig. 2. 95 % confidence level (CL) excluded region in the plane (m t /, nib/) with 
Rckm = 0.0002, obtained from limits on Bry^bz and Bry^cW- 




mb'(GeV) 

Fig. 3. 95 % CL excluded region in the plane {Rckm, my) with m t ' — my 
GeV, obtained from limits on Bry^bz (bottom) and Bry^cW (top). 



50 



there is always an excluded stripe around m t . As Rckm grows, i.e., CC 
dominates, the stripe gets larger and the other two regions in fig. 2 get 
smaller. This can also be seen in fig. 3 where for Rckm > 0.0015 everything 
is excluded. Obviously this will change if we change the mass difference. 

The reason why there isn't a lower bound close to 96 GeV in fig.3 is be- 
cause of the competing NC. Close to the Zb threshold (« 96 GeV), b' — > bg 
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dominates over b' — > bZ and the experimental bound on Bry^z becomes 
useless. As one moves away from the Zb threshold, b' — > bZ becomes the 
dominant NC. After 102 GeV almost all values are allowed because the 
experiments are not sensitive to those mass values. 




100 130 160 190 
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Fig. 4. 95 % CL excluded region in the plane (mf, my) with Rckm = 0.002, 
obtained from limits on Bry^bz by the CDF coll. and Bry^cW by the DO coll. 
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Fig. 5. 95 % CL excluded region in the plane {Rckm, my) with % — my = 50 
GeV, obtained from limits on Bry^bz by the CDF coll. (bottom) and Bry^cW 
by the DO coll. (top). Upper, Central and Lower curves correspond to the values 
used for the b' production cross-section. 
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In figs. 4 and 5 we show similar plots but using the CDF and the DO 
data. The behaviour follow the general trend explained for the DELPHI 
data. The DO deals with the CC and the CDF deals with the NC. The 
three curves marked upper, central and lower in fig. 5 are related with the 
theoretical error bars in the b' production cross section. In fig. 4 we have 
used central values for the cross sections. Again and for the same reason 
we see a stripe around mt in fig. 4. The stripe ends, as it should, for my 
close to 130 GeV which is approximately the DO bound on my. Notice that 
whatever the value of my is, one can always find an allowed m^ if Rckm 
is not too large. As Rckm — ► 0, Bry~>bZ ~ 100% and we recover the CDF 
bound 0. 

In some cases the allowed regions in the CDF/DO and DELPHI plots 
overlap and the excluded region grows. For instance, considering my = 100 
GeV and m t , - my = 50 GeV we get for DELPHI 4.5 x 10" 4 < R C km < 
8.4 x 10" 4 and for CDF/DO (lower) 6.7 x 10~ 4 < R C km < 1.1 x 10~ 3 . 
Hence, the resulting excluded region is 6.7 x 10~ 4 < Rckm < 8.4 x 10~ 4 . 

With the bound \V tb \ 2 + 0.75|U t / fe | 2 < 1.14 6 and assuming \V tb \ w 1 it 
is possible to limit the value of the matrix element V c y. For the same value 
of the b' mass, my = 100 GeV we know that Rckm < 8.4 x 10~ 4 and so 



with m t i = my + 50 = 150 GeV. The bound gets weaker for smaller m t i jjjj. 

Finally we mention that if new particles are added and the b' gets a new 
decay channel the excluded region will always shrink. This can be seen in 
[2] where an exclusion plot with the Higgs channel opened and a Higgs mass 
of 115 GeV is shown (see also 



Using all available experimental data for my > 96 GeV we have shown 
that there is still plenty of room for a sequential b' with a mass larger than 
96 GeV. This is our main conclusion. We have also shown that the allowed 
region depends heavily on the values of Rckm and m t >. The region where 
m t / sa m t is always excluded due to a 100 % CC. All plots show that Rckm 
is somewhere between 10 -4 and 10~ 2 which is a reasonable value regarding 
the CKM elements known so far. In fact, those CKM values suggest that 
V c y « 10~ 4 - 10~ 3 . If V t y «: 10" 1 then a value of Rckm between 10~ 2 and 
10~ 4 is absolutely natural. Moreover, the limit we have obtained for V c y in 
the last section makes it even more natural. 

We know that the DELPHI and also the CDF analysis are being im- 
proved and we hope to shrink the allowed region with this new data. 




4. Conclusion 
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As for the future, searches in hadron colliders will have to wait for the 
Runll of the Tevatron and for the Large Hadron Collider (LHC). The b'b' 
production cross section increases by roughly two orders of magnitude at 
the LHC compared to the Tevatron. Thus LHC will be a copious source of 
b' pairs. With high values for cross section and luminosity, if background is 
suppressed exclusion plots can be drawn for a very wide range of b' masses. 
For a detailed discussion on future searches see [3]. 

In summary we believe that there is still experimental and theoretical 
work to be done to find or definitely to exclude a sequential fourth generation 
of quarks at the electroweak scale. 

This work is supported by Fundagao para a Ciencia e Tecnologia under 
contract POCTI/FNU/49523/2002. S.M.O. is supported by FCT under 
contract SFRH/BD/6455/2001. 
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